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Abstract 

Matching-to-sample (MTS) training consists of presenting a stimulus as a sample followed by stimuli called comparisons 
from which a subject makes a choice. This study presents results of a pilot investigation comparing two packages for teach¬ 
ing university students to conduct MTS training. Two groups - control and experimental - with 2 participants in each group 
were used. Accuracy in conducting MTS training was assessed during baseline and post-training. During training the control 
group received a manual, and the experimental group received both the manual and computer-aided personalized system 
of instruction or CAPSI. Baseline and post-training combined scores for control and experimental groups were 72.5% and 
100%, and 72.7% and 95%, respectively. Results showed that the manual and the manual-plus-CAPSI packages produced 
similar effects in delivering knowledge in MTS training. We suggest that future studies using a larger sample size are neces¬ 
sary. In addition, we suggest that it is necessary to test new versions of the manual and the interaction of CAPSI with other 
components, such as demonstration videos. 
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M atching-to-sample (MTS) training consists of tasks in 
which a stimulus is presented as a sample, followed by 
two or more stimuli called comparisons. The subject 
makes a choice, for establishing conditional stimulus relations 
between the sample and its correct comparison (Green & Saun¬ 
ders, 1998). A number of research studies have investigated MTS 
training to produce stimulus equivalence, defined as responding 
in accord with behavioral tests of reflexivity, symmetry, and tran¬ 
sitivity (Arntzen & Lian, 2010), and also to teach a wide range 
of academic repertoires such as reading (Sidman, 1971), writ¬ 
ing (Stromer & Mackay, 1993), statistics (Critchfield & Fienup, 
2010; Fields, Travis, Roy, Yadlovker, Aguiar-Rocha, & Sturmey, 
2009), manual signs (Elias, Goyos, Saunders, & Saunders, 2008), 
mathematics skills (Lynch & Cuvo, 1995), braille literacy skills 
(Toussaint & Tiger, 2010), and brain-behavior relations (Fienup, 
Covey, & Critchfield, 2010). MTS tasks have also been used to 
investigate the acquisition of more elementary verbal relations, 
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such as tacts and pre-requisites for mands (Ribeiro, Elias, Goyos, 
& Miguel, 2010). Results suggest that MTS training may repre¬ 
sent a powerful teaching tool for use in educational settings. 

To date, however, few studies have investigated applications 
of MTS training in the classroom (Rehfeldt, 2011). In one of the 
first attempts to address this issue, Stromer, Mackay, and Stod¬ 
dard (1992) published an article aimed to provide an applied ap¬ 
proach for using MTS training to teach repertoires such as read¬ 
ing. In this work, the authors define reading based on the notion 
of equivalence networks involving dictated words, pictures, 
printed words, and spoken words by the student (Figure 1). 

Accordingly, using MTS training to teach reading usually in¬ 
volves explicit teaching of relations between dictated words and 
pictures (AB) and between dictated words and printed words 
(AC). In an MTS task involving the relation AB, a dictated word 
is presented as sample. As soon as the child responds to the sam¬ 
ple (e.g., by pointing to it), two or more pictures are presented as 
comparisons. The child then selects one of the comparisons and, 
as a result, she or he receives either praise for selecting the com¬ 
parison arbitrarily defined as correct, or a brief time-out period 
for selecting any other comparisons. MTS tasks involving the re¬ 
lation AC are presented in a similar manner, except that printed 
words are presented as comparisons. The child's performance 
in these tasks cannot be considered as reading though, because 
she or he could meet accuracy criterion simply by memorizing 






20 






A PILOT INVESTIGATION COMPARING INSTRUCTIONAL PACKAGES FOR MTS TRAINING 


21 


B 



C 

Figure 1. Stimulus equivalence network of reading. A, B and C are stimulus sets 
comprising dictated words, pictures, and printed words, respectively, and D represents 
spoken words by the student. Solid arrows are taught relations and dashed arrows 
emergent relations. Reprinted from Sidman, 1971, with permission. 

the words. Even if the child also passes tasks in which she or 
he is presented with a picture and asked to say its name (rela¬ 
tion BD), and in which she or he is presented with a printed 
word and asked to say its name (relation CD), explicit teach¬ 
ing of the relation AB is necessary for performances in reading 
comprehension, which is inferred by the emergence of relations 
between pictures and printed words (BC) and between printed 
words and pictures (CB) (Sidman, 1971). 

The work by Stromer and colleagues (1992) represents an im¬ 
portant step in the effort to transfer teaching methods derived 
from basic research to practical settings such as schools, an issue 
that currently is greatly emphasized within the field of behavior 
analysis (Mace & Critchfield, 2010). However, some variables 
that need to be taken into account are: (1) the suitability of MTS 
training for application in the classroom; and (2) the develop¬ 
ment of an approach for training teachers to conduct such train¬ 
ing to teach reading. 

With regard to the first issue, research on stimulus equiva¬ 
lence has employed procedures that can be broadly categorized 
as tabletop and automated (Saunders & Williams, 1998). In 
tabletop procedures, trials and delivery of consequences are ar¬ 
ranged by the experimenter, whereas in automated procedures 
they are computer-controlled (Dymond, Rehfeldt, & Schenk, 
2005). 

The use of tabletop procedures has been criticized in the lit¬ 
erature (Saunders & Williams, 1998). First, cuing effects are 
more likely to occur when tabletop procedures are used rais¬ 
ing questions about whether positive results are caused by the 
experimenter cuing rather than the training. Second, tabletop 
procedures require accurate and careful methodological control 
which, from a practical standpoint, may represent a barrier for 
teachers applying them in classroom. 

Rehfeldt (2011) carried out a citation analysis of studies that 
aimed to teach academic repertoires such as reading in prac¬ 
tice settings using the derived stimulus relations technology, a 
behavioral approach for the production of emergent behaviors; 
specifically, those involving relating events that were never re¬ 
lated to one another directly, after some other behaviors have 
been explicitly taught. Equivalence relations are an example 
of this. The analysis showed that 65% of the studies used auto¬ 
mated procedures whereas only 38% used tabletop procedures; 
some of these studies used both in combination (Rehfeldt, 


2011). These results strongly support the suitability of using au¬ 
tomated procedures in applied educational settings. 

Accordingly, we suggest that automated procedures can be 
reasonably used in the development of an approach for training 
teachers to conduct MTS training to teach reading in classroom. 
In the present study, we used MestreLibras (Elias & Goyos, 
2010), a stimulus-equivalence-based computer program devel¬ 
oped to teach stimulus relations and to test for emergent rela¬ 
tions such as those involved in basic reading (see Figure 1). The 
main features of the program include: (1) stimulus databases; 
(2) automatic trials; (3) MTS tasks databases; and (4) a perfor¬ 
mance data report. This program has been widely tested to teach 
repertoires such as reading and writing (Souza & Goyos, 2003), 
mathematical skills (Rossit, 2009), and manual signs (Elias, 
Goyos, Saunders, & Saunders, 2008). Results found in these 
studies are consistent with those found in stimulus-equivalence 
research (e.g., Sidman, 1971), supporting the effectiveness of 
this program as a teaching tool. 

With regard to the second issue mentioned above, the devel¬ 
opment of effective training approaches for teachers requires 
addressing the needs of teachers. For instance, on-the-job train¬ 
ing programs for teachers can be time intensive; thus, using an 
online approach can be beneficial in at least two ways: (1) cost- 
effectiveness, since it is possible to teach individuals from differ¬ 
ent places around the world using online course material, and 
(2) time effectiveness, since it is possible to teach individuals at 
the same time without the instructor being present (Scherman, 
2010 ). 

Computer-aided Personalized System of instruction (CAPSI) 
is an online version of the Personalized System of instruction 
(PSI; Keller, 1968). CAPSI has been validated as a teaching tool 
in courses taught at the University of Manitoba and other post¬ 
secondary institutions (Kinsner & Pear, 1998; Pear & Crone- 
Todd, 1999; Pear & Novak, 1996; Pear, Schnerch, Silva, Sven- 
ningsen, & Lambert, 2011). CAPSI-taught courses are based on 
textual material (e.g., a textbook) divided into study units with 
study questions on each study unit. During a course the students 
read the material at a place of their choosing, learn the answers 
to the study questions, and take online tests via CAPSI. The unit 
tests are typically composed of three or four study questions 
randomly selected by the system. As soon as a test is submitted 
for marking (i.e., grading), the system assigns it to either the 
instructor or to two other students, called peer-reviewers, who 
have already completed the current study unit. Marking con¬ 
sists of providing written feedback on students' answers, and 
can designate: (1) a “pass”, which indicates that the student is 
ready to proceed to the next unit test, or (2) a “re-study”, which 
requires the student to take a new test on the same unit after an 
hour of re-studying time. 

Although CAPSI has been widely tested for teaching psy¬ 
chology courses, its effectiveness as a Web-based teaching tool 
for training individuals working in applied settings is an issue 
that has been addressed only recently. For example, Scherman 
(2010) pioneered investigating CAPSI as an educational tool 
for the delivery of a self-instructional manual on Discrete Trial 
Teaching (DTT; Fazzio & Martin, 2011). The study used an ABA 
design with five participants. During baseline the participants 
were assessed in their skills on using DTT to teach three tasks 
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- imitation, matching, and pointing - with a confederate role- 
playing a child with autism. Training consisted of studying the 
DTT manual, completing online tests via CAPSI, and perform¬ 
ing DTT during scheduled sessions with the researcher prior to 
post-training. During post-training the participants were again 
assessed in their skills on implementing DTT to teach the above 
tasks. Results suggested that CAPSI in combination with the 
DTT manual was effective for training university students to 
use DTT to teach children with autism. 

Hu, Pear, and Yu (2012) investigated a multiple-component 
training consisting of: (1) a self-instructional manual on the As¬ 
sessment of Basic Learning Abilities (ABLA; available at http:// 
www.stamant.mb.ca/abla), (2) CAPSI, and (3) tutorial videos to 
teach individuals concepts on ABLA and also the implementa¬ 
tion of tasks called “levels” in ABLA. During baseline the par¬ 
ticipants completed written tests involving ABLA concepts and 
administered the ABLA levels with the first author role-playing 
a client. During training the participants studied the ABLA 
manual, completed online tests via CAPSI, and watched tutorial 
videos, which were delivered conditional upon the completion 
of each online test. During post-training participants were as¬ 
sessed on the same skills of those assessed during baseline and, 
in addition, they answered a survey on the usefulness of each 
component used in the training. Results showed that partici¬ 
pants’ accuracy in the written knowledge tests increased from a 
mean of 42 % during baseline to 82.6% after training and 85.6% 
during follow-up. Moreover, participants’ accuracy in the ap¬ 
plication tests increased from a mean of 26% during baseline to 
86% after training and 90% during follow-up.” These data sug¬ 
gest that CAPSI combined with both the ABLA manual and the 
tutorial videos was effective in teaching university students not 
only ABLA concepts but also the implementation of the ABLA 
levels. 

These studies demonstrated the feasibility of CAPSI as a Web- 
based educational tool for training individuals to implement be¬ 
havioral procedures, such as the DTT and the ABLA levels. In 
the present study we attempted to evaluate the effectiveness of 
two different packages: (1) a manual on the use of MTS training 
by itself; and (2) the manual in combination with CAPSI. 

The findings we present here are preliminary results from 
an investigation to address two specific questions: (1) would 
a comparison between the two packages result in the manu- 
al-plus-CAPSI package being more effective than the manual 
alone? and (2) would the manual-plus-CAPSI package result 
in an improvement from baseline to 90% accuracy or higher in 
conducting the MTS training? 

■ METHOD 


PARTICIPANTS, SETTINGS, AND MATERIALS 

Six students enrolled in an undergraduate second-year distance 
education psychology course taught at the University of Mani¬ 
toba signed up to participate in the study. They had no previous 
experience in conducting automated MTS training. The partici¬ 
pants were randomly assigned to one of the two groups, control 
or experimental. Four of them - two in the experimental group 
and two in the control group, as described below - successfully 


completed the study. The participants received credit toward a 
project in their course for their participation in the research. 

Baseline and post-training sessions took place in a room at 
the University of Manitoba, containing a table and two chairs 
placed side by side in front of the table. The MestreLibras com¬ 
puter program, installed in a laptop, a 16-page description of its 
use, a mouse, and a 4-page summary of steps on how to con¬ 
duct automated MTS training to teach reading were used dur¬ 
ing baseline and post-training. A 20-item checklist was used to 
evaluate the accuracy with which participants implemented the 
tasks. A video camera and a tripod were placed at approximately 
lm from the table and oriented at 220° toward the table. 

Training occurred at the participants' place of choosing. 
Training was based on a 27-page manual on how to conduct 
automated MTS training to teach reading, adapted from Goyos 
and Almeida (1994). This manual is composed of five chapters, 
each chapter associated with a study unit in CAPSI. The chap¬ 
ters provide brief descriptions of the following topics (where 
each number represents a chapter): (1) stimulus equivalence; 

(2) MTS procedures; (3) reading comprehension; (4) creating 
MTS tasks; and (5) implementing MTS tasks. The manual also 
contains 10 study questions per chapter corresponding to the 
topics being described and, for the last two chapters, exercises 
in which the student is asked to perform skills involved in con¬ 
ducting automated MTS training to teach reading. The CAPSI 
program was used to deliver unit tests. Participants required a 
personal computer and an Internet connection to access CAPSI. 
A computer with an Internet connection was used to provide 
participants with brief instruction on how to use CAPSI before 
training started. 

SCRIPT 

Conducting automated MTS training required the participants 
to: (1) create four MTS tasks; (2) evaluate reading repertoires; 

(3) conduct teaching sessions; and (4) conduct testing sessions. 
In 3 and 4, the experimenter (the first author) role-played a 
child. In 2-4, a script that specified the percentage of correct 
responses of the child in each MTS task was used. During read¬ 
ing repertoire evaluation, the percentage of role-played correct 
responses was 25% for all MTS tasks - AB, AC, BC, and CB. 
During teaching sessions, each of the MTS tasks - AB, and AC 
- was presented three times and the percentage of role-played 
correct responses was 25%, 50%, and 50%, respectively. During 
testing sessions, the percentage of correct responses was 100% 
for each of the MTS tasks - BC and CB. 

DESIGN, RESPONSE MEASUREMENT, AND INTEROBSERVER 
RELIABILITY (I0R) 

A group design composed of a control and an experimental 
group was used to compare the effectiveness of two packages 
consisting of “manual alone” and “manual-plus-CAPSI” for 
training university students to conduct automated MTS train¬ 
ing to teach reading. Performance accuracy was defined as cor¬ 
rectly performing the following steps: 

1. Creating four MTS tasks involving dictated words and pic¬ 
tures (AB), dictated words and printed words (AC), pic¬ 
tures and printed words (BC), and printed words and pic¬ 
tures (CB). Creating each task consisted of: (a) choosing 
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sample and comparison stimuli, (b) arranging trials, and 
(c) choosing the correct response for each trial. 

2. Evaluating an individual’s reading repertoire, defined as: (a) 
providing instructions for each task, (b) presenting 12 trials 
of each MTS task, and (c) not presenting feedback on tasks. 

3. Conducting teaching sessions, defined as: (a) providing in¬ 
structions for each task, (b) presenting two MTS tasks - 
AB and AC, (c) providing feedback for each task, and (d) 
repeatedly presenting each task until criterion was met on 
that task. 

4. Conducting testing sessions, defined as: (a) providing in¬ 
structions for each task, (b) presenting two MTS tasks - 
BC and CB, (c) not presenting feedback on tasks, and (d) 
repeatedly presenting the same task until criterion was met 
on that task. 

Sessions were videotaped and the participants' accuracy in con¬ 
ducting automated MTS training to teach reading was scored 
using a 20-item checklist. The percentage of steps performed 
correctly was calculated by dividing the total number of steps 
performed correctly by the total number of steps on the check¬ 
list, and this ratio was converted to a percentage. Interobserver 
reliability (IOR) was calculated by having two observers inde¬ 
pendently score 20% of the sessions. One observer watched 
the sessions and the other observer watched videotapes of the 
sessions. Using the same 20-item checklist they independently 
scored whether the participant performed each step correctly 
or incorrectly. A step was scored as an agreement if both ob¬ 
servers scored the step identically; otherwise, it was considered 
a disagreement. Percent agreement was calculated by dividing 
the number of agreements by the number of agreements plus 
disagreements and multiplying by 100 (Martin & Pear, 2011). 
Mean percentage agreement was 93.75%, ranging from 87.5% 
to 100%. Two observers determined procedural integrity using 
a 10-item procedural integrity checklist. The observers placed a 
checkmark in the “yes” column if the experimenter implement¬ 
ed a procedural step as indicated on the checklist; otherwise, 
they placed a checkmark in the “no” column. Procedural integ¬ 
rity checks were conducted for 20% of the sessions. According 
to these data, the experimenter correctly followed 100% of the 
procedural steps. 

PROCEDURE 

Baseline . During baseline participants were assessed individually. 
At the beginning of the session, the participants were provided 
with a laptop, the MestreLibras computer program, the 16-page 
description of its use, and the 4-page summary of steps that pro¬ 
vided abbreviated instructions on how to conduct automated 
MTS training to teach reading. Participants were then asked to 
read the material and, afterwards, using the 4-page summary 
of steps as a guide, to attempt to teach reading with the experi¬ 
menter role-playing a child. The participants used the MestreLi¬ 
bras 16-page description for displaying functions in the com¬ 
puter program that were related to the steps they were asked to 
perform. After reading the first page of the summary of steps, 
the participants made an attempt to create four MTS tasks - AB, 
AC, BC, and CB - each having 12 trials using the words “bee”, 
“bed”, and “cat”. After reading the second page of the 4-page 


summary of steps the participants attempted to evaluate reading 
repertoires with the experimenter role-playing a child. Twelve 
trials of the four MTS tasks were presented in the following 
manner. A trial started with a sample stimulus being presented 
alone. As soon as the “child” clicked with the mouse on the sam¬ 
ple, three comparison stimuli were presented and the child then 
chose one of them. No feedback on the “child's” responses was 
given. A new trial started after a 2-s inter-trial interval. After 
reading the third page of the summary of steps the participants 
made an attempt to conduct teaching sessions. Participants pre¬ 
sented MTS tasks in the same manner as described above except 
that: (1) MTS tasks presented were those involving AB and AC 
relations; (2) feedback on “child's” performance was provided 
and consisted of an animation in the screen following correct 
responses and a black screen following incorrect responses; 
and (3) each MTS task was presented until a criterion of 100% 
correct responses was met. After reading the fourth page of the 
summary of steps the participants made an attempt to conduct 
testing sessions. Participants presented MTS tasks in the same 
manner as described above, except that: (1) the MTS tasks were 
those involving BC and CB relations; and (2) each MTS task 
was presented until a criterion of 100% correct responses was 
met. (Note that these are ideal descriptions of a baseline ses¬ 
sion; however, since participants' performance during baseline 
was not completely accurate the descriptions did not necessarily 
correspond to the behaviors that were observed.) No feedback 
on the participants' performance was provided during baseline 
sessions and, at the beginning of the session, the participants 
were told that their questions would not be answered. Baseline 
sessions were videotaped and participants' accuracy in con¬ 
ducting automated MTS training to teach reading was assessed 
using the 20-item checklist mentioned previously. 

Training. After baseline, participants were randomly assigned to 
either the control or experimental group. Participants in con¬ 
trol group were given a hard copy of the 27-page manual men¬ 
tioned previously plus a CD-Room containing the MestreLibras 
computer program and the 16-page description for its use, and 
were asked to study the manual and answer the study questions 
provided in the manual. Participants in the experimental group 
were given the same materials that the participants in the con¬ 
trol group received. In addition, they were given a CAPSI user- 
name and password, and were provided with brief instruction 
on how to use CAPSI for taking unit tests and peer-reviewing, 
that is, marking tests of other participants on those units they 
have already completed. Participants in the experimental group 
were asked to study the manual, answer the study questions 
on it, and take unit tests on CAPSI. They were also asked to 
peer-review within 12h a test has been assigned to them; how¬ 
ever, they did not have opportunities to peer-review due to the 
small number of participants. Pirst, one participant started tak¬ 
ing tests late; because there were not two participants available 
for peer-reviewing, which was a requirement in the course, 
tests were automatically assigned to the instructor for marking. 
Second, one participant dropped out of the study after a week, 
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Table 1. Percentage accuracy on conducting MTS training from 
baseline to post-training for control and experimental groups. 




Baseline 

Post-training 


PI 

70% 

100% 

Control group 

P2 

75% 

100% 


Combined scores 

72.5% 

100% 


P3 

85% 

100% 

Experimental group 

P4 

60.41% 

90% 


Combined scores 

72.7% 

95% 


resulting in the other participant no longer being assigned for 
marking tests. 

As mentioned previously, the manual contained five chapters, 
and each chapter had an associated unit test delivered through 
CAPSI. The unit tests consisted of three questions randomly se¬ 
lected by the system. Participants were able to proceed to the 
next unit test only if their current unit test was marked as dem¬ 
onstrating mastery of the tested material. Because of the small 
number of participants in the CAPSI condition, there were no 
peer reviewers and all tests were assigned to the experimenter 
for marking, which was done within 24 hours of the comple¬ 
tion of the test. Marking consisted of providing detailed written 
feedback on participants' answers and could either designate 
a “pass” or a “re-study”. A pass indicated that the participants 
could proceed to the next unit, and a re-study indicated that 
they could request a new test in the same unit after an hour of 
re-studying the manual. Initially, all participants were given two 
weeks to complete training at a place of their choosing. Howev¬ 
er, participants in the experimental group had some difficulties 
in mastering the unit tests. After two of them appealed the tests 
(e.g., by saying that they would like to have more time so they 
could pass the units), a third week was given for participants in 
both the control and experimental groups. 

Post-training. Post-training occurred after all participants com¬ 
pleted the training. Participants were assessed for accuracy in 
conducting automated MTS training to teach reading in the 
same manner as described in the baseline. 

■ RESULTS AND DISCUSSION 

Table 1 presents percentage accuracy on conducting automated 
MTS training to teach reading. Only four participants - two in 
each group - completed the study; therefore, only data for these 
participants were analyzed. Percentage of correct responses for 
participants in each group and the overall mean score across 
participants is presented for baseline and post-training. 

The combined scores during baseline were 72.5% and 72.7% 
accuracy for control and experimental groups, respectively. 
During the post-training, the combined scores were 100% and 
95% accuracy for the control and the experimental groups, re¬ 
spectively. High baseline performance accuracy and, in addi¬ 
tion, accuracy greater than 90% during post-training were ob¬ 
served for both control and experimental groups. According to 
these results, the two packages - “manual alone” and “manual 
plus CAPSI” - produced similar effects in the control and ex¬ 


perimental groups' post-training performance accuracy in con¬ 
ducting automated MTS training to teach reading. 

We suggest that two main reasons may have accounted for 
that. First, the high percentage accuracy observed during the 
baseline produced a ceiling effect making it difficult to infer 
clear effects of each package on the improvements observed in 
the participants' performance during post-training. Second, 
because the sample size was very small, it is difficult to infer 
whether the results that were encountered were due to group 
effects or to random variation. 

These findings shed light on the current efforts to use equiv¬ 
alence-based methods to teach reading in applied educational 
settings (Rehfeldt, 2011). First, the results encountered may rep¬ 
resent a fruitful route in the development of effective approach¬ 
es for directly training individuals to conduct automated MTS 
training to teach reading. Second, the data showed that individ¬ 
uals can perform such skills with high levels of accuracy after a 
relatively short period of time (e.g., three weeks), indicating the 
time-effectiveness of the training approaches investigated in the 
present study. Third, we pioneered combining two different ar¬ 
eas of research within behavior analysis - stimulus equivalence 
and CAPSI - to address this issue. This can be considered an im¬ 
portant addition to the line of research investigating behavioral 
approaches to train professionals on the use of behavior analytic 
procedures in applied settings such as clinics and schools. In the 
following, we discuss some of the findings in more detail. 

In the post-training, percentage accuracy greater than 90% in 
conducting automated MTS training to teach reading was ob¬ 
served for both groups. Discussing this in terms of the contents 
presented in the manual, we highlight the fact that, for some 
chapters, study questions required participants not only to per¬ 
form their writing skills, but also their skills in conducting au¬ 
tomated MTS training. 

Recalling Scherman’s study (2010), for the units in the DTT 
manual that required practicing conducting DTT procedure, 
the participants were asked to schedule an appointment with the 
researcher to perform their DTT skills prior to post-training. 
However, this was not part of the “pass” requirements for the 
units and feedback on the participants' performance on imple¬ 
menting the DTT procedure was not given. Unlike Scherman's 
study, participants in the present study were required to sim¬ 
ply study the contents in the manual during training; however, 
for the units in the manual that required practicing conducting 
MTS, they were not required to perform their skills in sched¬ 
uled sessions prior to post-training. Future studies are neces¬ 
sary to evaluate systematically the effect of previous practice 
sessions on participants’ accuracy during post-training. 

The fact that high percentage accuracy was observed for par¬ 
ticipants in both groups during baseline deserves further atten¬ 
tion. First, their baseline performance was not totally naive. The 
participants were provided with a summary of steps for con¬ 
ducting automated MTS training to teach reading and, also, 
with a 16-page description for using the MestreLibras computer 
program. We felt this was necessary to prevent a large number 
of errors and, moreover, to make representative samples of task- 
related behaviors likely to occur. 

During the training participants in the experimental group 
reported difficulties in passing the unit tests. For example, all 
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participants in the experimental group received a re-study on 
at least one unit test; moreover, one participant dropped out of 
the study after some unsuccessful attempts to pass the units. Be¬ 
cause of the difficulties participants had passing unit tests, as 
mentioned previously, it was necessary to give all participants 
an additional week to complete the training. All these events 
may have added aversive features to the experimental condi¬ 
tions. The exact effects of such features on the overall partici¬ 
pants ' performance are not well known. Thus, we suggest that 
future research should be carried out to address the aforemen¬ 
tioned issue. 

For example, future studies could take care to minimize any 
aversive features produced by CAPSI - e.g., by providing small¬ 
er units of material - or make CAPSI a more positive experience 
- e.g., by including practical components in addition to written 
material. In particular, substantial improvements of CAPSI as a 
teaching tool for training professionals such as teachers, educa¬ 
tors, and staff working with children could be achieved by in¬ 
vestigating its interaction with demonstration videos, in which 
the practical use of a technique is taught using videotaped ex¬ 
amples (Catania, Almeida, Liu-Constant, & Reed, 2009). 

Although the participants in both groups performed MTS 
training with high levels of accuracy during post-training, the 
two packages investigated in this study - “manual alone” and 
“manual-plus-CAPSI” - produced similar effects in the partici¬ 
pants’ accuracy during post-training. We suggest that the com¬ 
bination of the manual with CAPSI deserves further investiga¬ 
tion - i.e., by addressing the aforementioned issues with regard 
to CAPSI features. 

Two limitations of the study are as follows: (1) the partici¬ 
pants’ performances were assessed under simulated conditions 
that may poorly represent the contingencies that are in effect 
in real-world classrooms. Specifically, the fact that we had the 
experimenter role-playing a child makes it difficult to infer the 
extent to which the participants could adequately conduct au¬ 
tomated MTS training to teach reading to an actual child fol¬ 
lowing training. (2) the training focused on a circumscribed 
set of skills. According to some authors (Goyos & Freire, 2000; 
Green & Saunders, 1998), the implementation of equivalence- 
based methods requires more complex skills such as: (a) deci¬ 
sion making with regard to the behaviors to be taught in order 
to obtain the desired emergent behaviors; (b) careful analysis 
of the child's performance session by session; and (c) decision 
making with regard to the adequacy of the training and testing 
protocols to produce effective learning. 

Considering that CAPSI has been used to teach higher-order 
thinking repertoires (Crone-Todd & Pear, 2001), perhaps these 
skills would be more suitable for teaching via CAPSI than the 
procedures taught in the present study. Future studies could 
investigate not only the effectiveness of CAPSI to teach perfor¬ 
mance-based skills in implementing equivalence-based meth¬ 
ods, but also to teach knowledge on stimulus equivalence, in 
which knowledge is defined in accord with Bloom's taxonomy 
(1956). 

In addition, future investigations should aim at evaluating the 
peer-reviewing component, which was not possible in this study 
due to the fact that only two participants in the experimental 
group completed the study. (However, an experimenter or in¬ 


structor could specify only one peer reviewer per test, thus pro¬ 
viding peer-reviewing experience for at least one participant.) 
This may make relevant contributions to improving CAPSI’s 
use in the development of teachers training programs in at least 
two ways: (1) the peer-reviewing component is important as a 
way to ensure that feedback will be given within a short period 
time; and (2) peer-reviewing may also contribute to learning by 
those who do the peer reviewing. However, its role in learning 
deserves further analysis (Martin, Pear, & Martin, 2002). 

Given the limitations that were discussed, the present study is 
nevertheless encouraging in light of recent debate on the need 
of bringing the technology derived from research in behavior 
analysis to practical settings. Accordingly, the application of 
stimulus equivalence in applied educational settings such as 
classrooms has been addressed through concrete steps provided 
by research within behavior analysis. 
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